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Security  Cooperation  Assessment 


Problem  Definition 

•  Global  Combatant  Commands  (GCCs)  conduct  security 
cooperation  activities  with  partner  nations  across  their 
sphere  of  influence  in  support  of  nation  security  objectives 

•  Defense  Security  Cooperation  Agency  (DSCA)  is  charged 
with  the  development,  implementation,  assessment  and 
coordination  of  security  cooperation  plans  and  programs 
for  DoD 

•  Assessment  is  challenged  by  incompatible  methods  and 
metrics  across  GCCs,  incomparable  evaluations,  false 
interactions,  lack  of  meaningful  or  objectives-based 
analysis 


Security  Cooperation  Assessment 


Objective 

•  Develop  a  common,  repeatable,  logical  and 
simple  quantitative  assessment  process  of  the 
return  on  investment  of  security  cooperation 
efforts  across  Global  Combatant  Commands 
(GCCs) 

•  Assess  how  well  diverse  security  cooperation 
activities  are  supporting  program  objectives 

•  Provide  decision  makers  with  information  on  the 
effectiveness  of  security  cooperation  efforts 
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Approach 

•  Develop  a  methodology  that: 

-  Measures  progress  resulting  from  security  cooperation  activities  vs. 
goals  (or  initial  assessments) 

-  Uses  weights  that  reflect  priorities  and  expectations  of  GCCs  with 
respect  to  partners  and  objectives 

-  Focuses  internally,  at  the  GCC  level,  on  progress  by  country  and 
objective 

•  Recognize  that: 

-  Priorities,  partners  and  objectives  may  change  year  to  year 

-  Some  outcomes  are  not  directly  linked  to  or  caused  by  security 
cooperation  programs 
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Security  Cooperation  Assessment 


Notional  Example 

Pre-FY  Tasks:  DSCA 


•  ID  Critical  Objectives  and  Sub-objectives  for 
all  GCCs 

-  A5,  A6,  D1,  D2,  D3  (2  sub-objectives  each) 

-  Example  Objective: 

•  Reform  the  defense  establishment  of  select 
countries 

-  Example  Sub-objective: 

•  Establish  a  professional  NCO  corps 
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Notional  Example 

Constructed  Scales 

•  Build  Constructed  Scales  for  each  sub-objective 

-  Based  on  SME  and  GCC  input 

-  General  enough  to  apply  to  all  partners  across  GCCs 

•  Simple,  Logical  Scales 

-  A  =  worst  case  scenario  (no  professional  NCO  corps) 

^^^^^Interim  stages  define  a  logical  progression^^^^^ 

in  achievement  of  the  goal/ideal 

-  E  =  ideal  (well  developed,  seasoned  NCO  corps  in  place) 
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Notional  Example 

Value  Functions 

•  Create  Value  Functions  for  each  sub-objective 

-  Based  on  SME  and  GCC  input 


CONSOLIDATED  VALUE  FUNCTIONS  FOR  ALL  SUB-OBJECTIVES  (NOTIONAL) 


Sub-Objective 

Score 

A5.1 

A5.2 

A6.1 

A6.2 

D1.1 

D1.2 

D2.1 

D2.2 

D3.1 

D3.2 

A 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

B 

3 

2 

4 

5 

2 

7 

3 

3 

2 

5 

C 

5 

3 

7 

6 

3 

8 

4 

5 

5 

6 

D  ^ 

7 

6 

8 

9 

4 

9 

7 

7 

9 

9 

E  ' 

10 

10 

10 

10 

10 

10 

10 

10 

10 

10 

Constructed  Scales 


A5.1 

A5.2 

-A- 

A6.1 

A6.2 

D1.1 

D1.2 

- h- 

D2.1 

D2.2 

D3.1 

D3.2 

Notes: 

Must  increase  -  cannot  stay  the  same 
Must  start  with  1  and  end  with  10 
A  =  worst  case 
E  =  ideal 
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Notional  Example 

Pre-FY  Tasks:  GCCs 

•  Identify  Priority  Partners  (PPs) 

•  Align  Priority  Partners  and  Sub-objectives 

•  PPSO  pairs 


GCCX 

10  Priority  Partners 


Objectives 


Partner 

A5 

No 

D1 

D2 

D3 

A5.1  A5.2 

A6.1  A6.2 

D1.1  D1.2 

D2.1  D2.2 

D3.1  D3.2 

1 

X  X 

X  X 

X  X 

X 

2 

X  X 

X 

X  X 

X 

3 

X  X 

X 

X  X 

X  X 

4 

X  X 

X 

X  X 

5 

X  X 

6 

X 

X  X 

X 

X 

7 

X  X 

8 

X 

X  X 

X  X 

X  X 

9 

X 

X 

X 

X  X 

10 

X 

X  X 

X  X 
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Notional  Example 

Weightings  by  GCCs 


Use  Swing  Weight  Matrix  to  Determine  Objective  and 
Sub-objective  Weights 


OBJECTIVE  A5  (Notional) 

IMPORTANCE  (Reflects  Priorities  in  Country  an(d  Sub-Objective) 


Great 


Some 


Minimal 


13 


Critical 

Significant 

Considerable 

3-A5.1 

1-A5.2 

9-A5.1 

3-A5.2 

100 

75 

35 

1-A5.1 

6-A5.1 

2-A5.1 

8-A5.1 

90 

50 

20 

2-A5.2 

80 

40 

1 

Linked  to 
National  Security 
Objectives 


Security  Cooperation  Assessment 


Notional  Example 

Weighting 


•  Use  Swing  Weight  Matrix  to  Determine  Objective  and 
Sub-objective  Weights 

•  Reflect  priorities  and  potential 


OBJECTIVE  A5 


PPSO 

Roll  Up 

Partner 

A5.1  Value  Weight 

A5.2  Value  Weight 

1 

X  90  0.173 

X  75  0.144 

2 

X  20  0.038 

X  1  0.002 

3 

X  100  0.192 

X  100  0.192 

4 

0.000 

0.000 

5 

0.000 

0.000 

6 

X  50  0.096 

0.000 

7 

0.000 

0.000 

8 

X  50  0.096 

0.000 

9 

X  35  0.067 

0.000 

10 

0.000 

0.000 

345 

176 

Tot  Value 
521 


Great 


Some 


Minimal 


IMPORTANCE  (Reflects  Priorities  in  Country  and  Sub-Objective) 

◄ - 


Critical 

Significant 

Considerable 

3-A5.1 

1-A5.2 

9-A5.1 

3-A5.2 

100 

75 

35 

1-A5.1 

6-A5.1 

2-A5.1 

8-A5.1 

90 

50 

20 

2-A5.2 

80 

40 

1 
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Notional  Example 

Pre  Tasks:  GCCs 


•  Roll  up  Objective  and  Sub-objective  Weights 
Across  Priority  Partners 


Objectives 

A5 

A6 

D1 

D2 

D3 

A5.1  A5.2 

A6.1  A6.2 

D1.1  D1.2 

D2.1  D2.2 

D3.1  D3.2 

PP  Total 

%  Total 

0.173  0.144 

0.159  0.097 

0.047 

0.892 

17.8% 

0.038 

0.192 


0.002 

0.192 


Security  Cooperation  Assessment 


Notional  Example 

Goals  /  Assessments  by  GCCs 


•  Assess  each  PPSO  pair  using  Constructed  Scales  and 
convert  to  Value  Scores  using  Value  Functions 

Pre-FY  Assessment  -  Scale  Score 


Partner 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


Partner 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
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Notional  Example 

Initial  Weighted  Value  Scores 


Apply  weights  to  Value  Scores  and  roll  up  weighted  values  by 
Sub-objective,  Objective,  and  Priority  Partner 


PRE-FY  WEIGHTED  VALUE 


Partner 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


0.671  0.177 


Total  -  SO 

2.831  1  0.827 

2.136 

3.019 

1.066  1  2.875 

1.880 

2.067 

1.264 

2.250 

Total  -  Obj 

3.658 

5.155 

3.941 

3.947 

3.514 

%  Max 

37% 

52% 

39% 

39% 

35% 

Total  -  PP 

Max 

%  Max 

2.461 

8.915 

28% 

1.764 

3.725 

47% 

4.091 

9.604 

43% 

0.774 

2.203 

35% 

1.184 

2.632 

45% 

2.659 

5.609 

47% 

0.118 

1.184 

10% 

3.433 

6.298 

55% 

1.755 

4.290 

41% 

1.975 

5.538 

36% 
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Notional  Example 

Post-FY  Tasks:  GCCs 

-  Assess  each  PPSO  pair  using  Constructed  Scales  and  convert  to  Value 
Scores  using  Value  Functions 

Post-FY  Assessment  -  Scale  Score 

Partner 
1 
2 

3 

4 

5 

6 

7 

8 

9 

10 


Partner 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


A5 

A6 

D1 

D2 

D3 

A5.1 

A5.2 

A6.1 

A6.2 

D1.1 

D1.2 

D2.1 

D2.2 

D3.1 

D3.2 

C 

B 

A 

A 

B 

B 

E 

B 

E 

C 

C 

B 

C 

D 

C 

B 

D 

C 

C 

C 

D 

D 

D 

B 

A 

B 

C 

B 

E 

C 

B 

C 

C 

B 

D 

D 

D 

B 

A 

B 

B 

D 

C 

D 

B 

B 

C 

C 

D 

A 

B 

Post-FY  Assessment  -  Value  Mapping 

A5 

A6 

D1 

D2 

D3 

A5.1 

A5.2 

A6.1 

A6.2 

D1.1 

D1.2 

D2.1 

D2.2 

D3.1 

D3.2 

5 

2 

1 

1 

3 

3 

10 

3 

10 

7 

3 

7 

5 

7 

3 

4 

4 

8 

4 

5 

4 

9 

7 

2 

1 

2 

8 

3 

10 

6 

3 

6 

3 

7 

- - - 

7 

8 

9 

2 

1 

2 

5 

7 

7 

7 

2 

5 

6 

4 

7 

1 

5 
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Notional  Example 

Analysis  of  Results 


•  Roll  up  weighted  values  by  Sub-objective,  Objective,  and  Priority  Partner 

•  Compare  Pre-FY  and  Post-FY  Total  Weighted  Values  for  Objectives  and 
Priority  Partners 

-  Identify  areas  of  significant  improvement  or  decline  to  address  in  detail 

CT^RIVE  DlSCUSSIOhP':^ 


POST-FY  WEIGHTED  VALUE 


A5 

A6 

D1 

D2 

D3 

A5.1 

A5.2 

A6.1 

A6.2 

D1.1  1 

D1.2 

D2.1 

D2.2 

D3.1 

D3.2 

-1.0% 


Total  -  PP 

Max 

%  Max 

2.663 

8.915 

30% 

1.843 

3.725 

49% 

4.779 

9.604 

50% 

0.815 

2.203 

37% 

1.316 

2.632 

50% 

3.451 

5.609 

62% 

0.592 

1.184 

50%  , 

3.058 

6.298 

49% 

1.911 

4.290 

45% 

2.110 

5.538 

38% 

ly 
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Future  Work 

•  Assessing  Value  vs.  Resources 

-  Compare  value  changes  to  resource 
allocation 

•  Developing  Compelling  Presentation  of 
Information  /  Visualizations 

•  Developing  an  Adaptable,  User  Friendly, 
Excel-based  System  to  Facilitate  the 
Process 
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